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ABSTRACT 

This paper proposes a robust reduced-rank scheme for adaptive beam- 
forming based on joint iterative optimization (JIO) of adaptive filters. 
The scheme provides an efficient way to deal with filters with large 
number of elements. It consists of a bank of full-rank adaptive fil- 
ters that forms a transformation matrix and an adaptive reduced-rank 
filter that operates at the output of the bank of filters. The trans- 
formation matrix projects the received vector onto a low-dimension 
vector, which is processed by the reduced-rank filter to estimate the 
desired signal. The expressions of the transformation matrix and the 
reduced-rank weight vector are derived according to the constrained 
constant modulus (CCM) criterion. Two novel low-complexity adap- 
tive algorithms are devised for the implementation of the proposed 
scheme with respect to different constrained conditions. Simulations 
are performed to show superior performance of the proposed algo- 
rithms in comparison with the existing methods. 

Index Terms — Beamforming techniques, antenna array, con- 
strained constant modulus, reduced-rank methods, joint iterative op- 
timization. 

1. INTRODUCTION 

Adaptive beamforming technology is of paramount importance in 
numerous signal processing applications such as radar, wireless com- 
munications, and sonar (TJ-(3) . Among various beamforming tech- 
niques, the beamformers according to the constrained minimum vari- 
ance (CMV) criterion |3| are prevalent, which minimize the total 
output power while maintaining the gain along the direction of the 
signal of interest (SOI). Another alternative beamformer design is 
performed according to the constrained constant modulus (CCM) 
criterion, which is a positive measure [3] of the average amount 
that the beamformer output deviates from a constant modulus con- 
dition. Compared with the CMV, the CCM beamformers exhibit 
superior performance in many severe scenarios (e.g., steering vector 
mismatch) since the positive measure provides more information for 
the parameter estimation. 

Many adaptive algorithms have been developed according to the 
CMV and CCM criteria for implementation. A simple and popular 
one is stochastic gradient (SG) method |4), |7). A major drawback 
of the SG-based methods is that, when the number of elements in the 
filter is large, they always require a large amount of samples to reach 
the steady-state. Furthermore, in dynamic scenarios, filters with 
many elements usually show poor performance in tracking signals 
embedded in interference and noise. Reduced-rank signal process- 
ing was motivated to provide a way out of this dilemma [8 ], (5). For 
the application of beamforming, the reduced-rank technique project 
the received vector onto a low-dimension subspace and perform the 
filter optimization within this subspace. One popular reduced-rank 



scheme is the multistage wiener filter (MSWF), which employs the 
minimum mean squared error (MMSE) [10], and its extended ver- 
sions that utilize the CMV and CCM criteria were reported in 01 11 . 
1121 . Another technique that resembles the MSWF is the auxiliary- 
vector filtering (AVF) 1131 , 11141 . Despite improved convergence and 
tracking performance achieved by these methods, their implemen- 
tations require high computational cost and suffer from numerical 
problems. A joint iterative optimization (JIO) scheme, which was 
presented recently in 1191 , employs the CMV criterion with a low- 
complexity adaptive implementation to achieve better performance 
than the existing methods. 

Considering the fact that the CCM-based beamformers outper- 
form the CMV ones for constant modulus constellations, we propose 
a robust reduced-rank scheme according to the CCM criterion for the 
beamformer design. The proposed reduced-rank scheme consists of 
a bank of full-rank adaptive filters, which constitutes the transfor- 
mation matrix, and an adaptive reduced-rank filter that operates at 
the output of the bank of filters. The transformation matrix projects 
the full-rank received vector onto a low-dimension, which is then 
processed by the reduced-rank filter to estimate the desired signal. 
The transformation matrix and the reduced-rank filter are computed 
based on the JIO. The proposed scheme provides an iterative ex- 
change of information between the transformation matrix and the 
reduced-rank filter, which leads to improved convergence and track- 
ing ability and low-complexity cost. We devise two adaptive algo- 
rithms for the implementation of the proposed reduced-rank scheme. 
The first one employs the SG approach to jointly estimate the trans- 
formation matrix and the reduced-rank weight vector subject to a 
constraint on the array response. The second proposed algorithm is 
extended from the first one and reformulates the transformation ma- 
trix subject to an orthogonal constraint. The Gram Schmidt (GS) 
technique 1211 is employed to realize the reformulation. The perfor- 
mance of the second method outperforms the first one. Simulation 
results are given to demonstrate the preferable performance and sta- 
bility achieved by the proposed algorithms versus the existing meth- 
ods in typical scenarios. 

2. SYSTEM MODEL AND PROBLEM STATEMENT 
2.1. System Model 

Let us suppose that q narrowband signals impinge on an uniform 
linear array (ULA) of m (m > q) sensor elements. The sources 
are assumed to be in the far field with directions of arrival (DOAs) 
8o,. . . ,0q-i. The ith received vector x(i) £ c mxl can b e modeled 
as 

x(i) = A(0)s(i)+n(i), i = l,...,N (1) 

where = [9 , q -i] T € C qxl is the signal DOAs, A{9) = 
[a(8o), ■ ■ ■ ,a(O q -i)] 6 c mx <? comprises the signal direction vec- 



tors a(6 k ) = [1, e 
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(A; = 0, . . . , q — 1), where A c is the wavelength and d is the inter- 
element distance of the ULA (d — A c /2 in general), and to avoid 
mathematical ambiguities, the direction vectors a(8k) are consid- 
ered to be linearly independents. s(i) £ C 9Xl is the source data, 
n(i) £ C mxl is temporarily white sensor noise, which is assumed 
to be a zero-mean spatially and Gaussian process, TV is the observa- 
tion size of snapshots, and (-) T stands for transpose. The estimated 
desired signal is given by 



V(i) 



w H (i)x(i) 



(2) 



where w(i) — [wi (i), . . . , w m (i)] T £ C mxl is the complex weight 
vector, and (-) H stands for Hermitian transpose. 

2.2. Problem Statement 

Let us consider the full-rank CCM filter for beamforming, which can 
be computed by minimizing the following cost function 

Jcm(w(i)) =E{[|y( l )| 2 -l] 2 }, subject to w H {i)a(8 ) = 1 

(3) 

where 9o is the direction of the SOI and a(8o) denotes the corre- 
sponding normalized steering vector. The cost function is the ex- 
pected deviation of the squared modulus of the array output to a 
constant subject to the constraint on the array response, which is set 
to capture the power of the desired signal and ensure the convexity 
of the cost function. The weight expression obtained from ((3) is 



w(i + l) = R- 1 (i){p( 
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(4) 

where R(i) = E[\y(i)\ 2 x{i)x H (i)], p{i) = E[y* {i)x(i)\, and (•)* 
denotes complex conjugate. Note that I0 is a function of previous 
values of w(i) (since y(i) = w H (i)x(i)) and thus must be ini- 
tialized to start the iteration. We keep the time index in R(i) and 
p(i) for the same reason. It is obvious that the calculation of weight 
vector requires high complexity due to the matrix inversion. The 
SG type algorithms can be employed to reduce the computational 
load but still suffer from slow convergence and tracking performance 
when the dimension m is large. The reduced-rank schemes like 
MSWF and AVF can be used to improve the performance but still 
need high computational cost and suffer from numerical problems. 

3. PROPOSED REDUCED-RANK SCHEME AND CCM 
FILTERS DESIGN 

In this section, by proposing a reduced-rank scheme based on the JIO 
of adaptive filters, we introduce a minimization problem according 
to the CM criterion subject to different constraints. The reduced- 
rank CCM filters design is described in details. 

3.1. Proposed Reduced-Rank Scheme 

Define a transformation matrix T r (i) = [ti(i), ti{i), ■ ■ ■ , t r (i)] £ 
C mxr , which is responsible for the dimensionality reduction, to 
project the mxl received vector x (i) onto a lower dimension, yield- 
ing 

x(i) = Tf (i)x(i) (5) 

where t;(i) = [t u (i), . . . , t m ,i{i)] T £ C mxl , I = 1, r, makes 
up the transformation matrix T r (i), x(i) £ C rxl is the projected 
received vector, and in what follows, all r-dimensional quantities 
are denoted by an over bar. Here, r < m is the rank and, as we will 



see, impacts the output performance. An adaptive reduced-rank filter 
represented by w(i) — [wi(i), . . . , w r (i)] T £ C rxl is followed to 
get the filter output 



y(i) = w H (i)Tr (i)x(i) 



(6) 



From the filter output y(i) depends on T r (i) and w(i), as 
shown in Fig. Q] It is necessary to jointly estimate T r (i) and w(i) 
to get y(i). We consider a reduced-rank CM minimization problem 
subject to different constraints, which are 



Jem.no (T r (i), «>(*)) =E{[\y(i)\ 2 -l] 2 } 
subject to w H (i)T^ (i)a(8o) = 1 

Jcmjio(T r {i),w(i)) = E{[\y{i)\ 2 - l] 2 } 

subject io w H (i)Tr {i)a(8 ) = 1 and T" (i)T r {i) = / 
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Fig. 1. Proposed reduced-rank beamforming scheme. 

Compared with Q, the constraint in (|8} includes one orthogo- 
nal constraint on the transformation matrix, which is to reformulate 
T r (i) for the performance improvement. In the following part, we 
will derive the CCM expressions of T r (i) and w(i) with respect 
to Q. The proposed adaptive algorithm for the implementation of 
(0 and the extended algorithm with respect to ((8} will represent in 
Section 4. 

3.2. Design of Reduced-rank CCM Filters 

Substituting ® into Q, the cost function can be transformed by the 
method of Lagrange multipliers into an unconstrained one, which is 
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r(*),«(0) = E{ [\w H (l)T?(i)x(i)\ 2 - 1] 2 } 

{\[w H {i)T? (i)a{e Q ) - 1]} 



(9) 



+ 2SR 



where A is a scalar Lagrange multiplier and the operator SRQ selects 
the real part of the argument. Assuming w(i) is known, minimizing 
((9) with respect to T r (i) equal to a null matrix and solving for A, we 
have 



T r {i + 1) = i2 _1 (i){p(i)«' H (i)- 

[w H {i)R^\i)w{i)p H {i)R- 1 {i)a{e ) - l]a{6 )w H {i) 
w H (i)Rl\i)w{i)a H (6 )R- 1 (i)a(6 ) 



}R^(i) 
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wherep(i) = E[y* (i)x(i)] £ C mxl ,R(i) = E[\y(i)\ 2 x(i)x H £ 
C mxm , and R^(i) = E[w(i)w H {i)] £ C rxr . Note that the 
reduced-rank weight vector w(i) depends on the received vectors 
that are random in practice, thus Rw (i) is full-rank and invertible. 
R(i) and p(i) are functions of previous values of T r and w due to 
the presence of y(i). Therefore, it is necessary to initialize T r (i) 
and w(i) to estimate R(i) and p(i), and start the iteration. 



On the other hand, assuming T r (i) is known, minimizing l[9} 
with respect to w(i) equal to a null vector and solving for A, we 
obtain 

lull + 1) = it WiPUj-- = — q } 

(ID 

where = E[\y(i)\ 2 T? (i)x{i)x H {i)T r {{)] G C rxr , p(i) = 
E[y*{i)T?(i)x(i)] € C rxl , and a(0 o ) = T?{i)a(G ) e C rxl . 

The expressions in dlO) for the transformation matrix and (II It 
for the reduced-rank weight vector depend on each other and so are 
not closed-form solutions. It is necessary to iterate TV and w with 
initial values for implementation. Therefore, the initialization is not 
only for estimating y but starting the iteration. The proposed scheme 
provides an iterative exchange of information between the transfor- 
mation matrix and the reduced-rank filter, which leads to improved 
convergence and tracking performance. They are jointly estimated 
to solve the CCM minimization problem. 

4. DEVELOPMENT OF ADAPTIVE ALGORITHMS 

4.1. Proposed Adaptive SG Algorithm for (7) 

We describe a simple adaptive algorithm for implementation of the 
proposed reduced-rank scheme according to the minimization prob- 
lem in 0. Assuming w(i) and T r (i) are known, respectively, tak- 
ing the instantaneous gradient of ([9} with respect to TV (i) and w(i), 
and setting them equal to null matrices, we obtain 

VJ Tr = 2e(i)y*(i)x(i)w H (i) + \ Tr a(6 )w H (i) (12) 

yjw = 2e{i)y*(i)T?{i)x{i) + A„Tf \i)a(8 ) (13) 

where e(i) — \y(i)\ 2 — 1, Xr r and A™ are the corresponding La- 
grange multipliers. Following the gradient rules T r (i+1) = T r (i) — 
HT-r^J Jt t and w(i + 1) = w(i) — n-w^Jw, substituting d!2t and 
d!3t into them, respectively, and solving Xr r and Auj by employing 
the constraint in Q, we obtain the iterative solutions in the form 

T r (i + 1) = T r {i)-i*r r e{i)v*{i) [a»(0* H (0 

(14) 

— a(8o)w (i)a (i)x(i)] 

w(i + 1) = w(i) - n*e(i)y\i) [I - jjg°jg^ ]s(i) (15) 

where fPr T and fi^ are the corresponding step sizes, which are small 
positive values. The transformation matrix T r (i+1) and the reduced- 
rank weight vector w(i + 1) are jointly updated. The filter output 
y(i) is estimated after each iterative procedure with respect to the 
CCM criterion. We denominate this algorithm as JIO-CCM. 

4.2. Extended Algorithm for <S> 

Now, we consider the minimization problem in ([§}. As explained be- 
fore, the constraint is added to orthogonalize a set of vectors t; (i+1) 
for the performance improvement. We employ the Gram-Schmidt 
(GS) technique 1211 to realize this constraint. Specifically, the adap- 
tive SG algorithm in d!4t is implemented to obtain TV (i + 1). Then, 
the GS process is performed to reformulate the transformation ma- 
trix, which is 1211 

i-i 

ti, mt (i + 1) = ti(i + 1) - ^proj t . ifflt ( i+ i)*i(* + !) (I 6 ) 

3=1 



Table 1. Computational complexity 
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where t; ]0rt (i + 1) is the normalized orthogonal vector after GS pro- 
cess and proj tj . m(4+1) t; = tf olt (i + l)t t (i+l) t uji^l^ (i . 
is a reformulation operator. 

The reformulated transformation matrix T r , on (i + 1) is con- 
structed after we obtain a set of orthogonal ii, M t(i+l), I ~ l,...,r. 
By employing T r , on (i + 1) to get x(i), a(9o), and jointly update 
with w(i + 1) in (15) , the performance can be further improved. 
Simulation results will be given to show this result. We denominate 
this GS version algorithm as IIO-CCM-GS, which is performed by 
computing d!4t . d!6t . and d!5t . 

The computational complexity with respect to the existing and 
proposed algorithms is evaluated according to additions and mul- 
tiplications. The complexity comparison is listed in Table Q] The 
complexity of the proposed IIO-CCM and JIO-CCM-GS algorithms 
increases with the multiplication of rm. The parameter m is more 
influential since r is selected around a small range that is much less 
than m for large arrays, which will be shown in simulations. This 
complexity is about r times higher than the full-rank algorithms |4], 
slightly higher than the recent JIO-CMV algorithm [12], but much 
lower than the MSWF-based ED, CD, and AVF [13] methods. 

5. SIMULATIONS 

Simulations are performed by an ULA containing m — 32 sensor el- 
ements with half-wavelength interelement spacing. We compare the 
proposed JIO-CCM and JIO-CCM-GS algorithms with the full-rank 
0, MSWF fTT], (HI, and AVF (13) methods and in each method, 
the CMV and CCM criteria are considered with the SG algorithm 
for implementation. A total of K — 1000 runs are used to get the 
curves. In all experiments, the BPSK source power (including the 
desired user and interferers) is a 2 — of = 1 and the input SNR 
= 10 dB with spatially and temporally white Gaussian noise. 

In Fig. [2] we consider the presence of q — 7 users (one de- 
sired) in the system. The transformation matrix and the reduced- 
rank weight vector are initialized with TV(0) = [ij 0^ x ( m _ r j] 
andw(0) = (Tf (O)a(0 o ))/(]|Tf (O)a(0 o )|| 2 ) to ensure the con- 
straint in ([7). The rank is r — r gs — 5 for the proposed JIO-CCM 
and JIO-CCM-GS algorithms. Fig. |2] shows that all output SINR 
values increase to the steady-state as the increase of the snapshots. 
The JlO-based algorithms have superior steady-state performance as 
compared with the full-rank, MSWF, and AVF methods. The GS 
version algorithms enjoy further developed performance comparing 
with corresponding JIO-CMV and JIO-CCM methods. Checking 
the convergence, the proposed algorithms are slightly slower than 



the AVF, which is least squares (LS)-based, and much faster than the 
other methods. 
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- MSWF-CMV 
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Fig. 2. Output SINR versus the number of snapshots with fir r = 
0.002, fim = 0.001, ^ T ,.,g S = 0.003, jUe.g, = 0.0007. 

In Fig. [3] we keep the same scenario as that in Fig. [2] and 
check the rank selection for the existing and proposed algorithms. 
The number of snapshots is fixed to TV = 500. The most adequate 
rank values for the proposed algorithms are r — r gs = 5, which 
are comparatively lower than most existing algorithms, but reach the 
preferable performance. We also checked that these values are rather 
insensitive to the number of users in the system, to the number of 
sensor elements, and work efficiently for the studied scenarios. 
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Fig. 3. Output SINR versus dimension (m) with fpr r 
(Mb = 0.001, //T r , g8 = 0.003, /te, gs = 0.0007. 
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Finally, the mismatch (steering vector error) condition is ana- 
lyzed in Fig. [4] The number of users is q = 10, including one 
desired user. In Fig. |4ja), the exact DOA of the SOI is known at the 
receiver. The output performance of the proposed algorithms is bet- 
ter than those of the existing methods, and the convergence is a little 
slower than that of the AVF algorithm, but faster than the others. In 
Fig. |4fb), we set the DOA of the SOI estimated by the receiver to 



be 2° away from the actual direction. It indicates that the mismatch 
problem induces performance degradation to all the analyzed algo- 
rithms. The CCM-based methods are more robust to this scenario 
than the CMV-based ones. The proposed algorithms still retain out- 
standing performance compared with other techniques. 
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Fig. 4. Output SINR versus the number of snapshots with /it,. = 
0.002, /t^ = 0.001, /LtT r , g8 = 0.003, /te, gs = 0.0007 for (a) ideal 
steering vector condition; (b) steering vector mismatch 2°. 



6. CONCLUDING REMARKS 

We proposed a CCM reduced-rank scheme based on the joint iter- 
ative optimization of adaptive filters for beamforming and devised 
two efficient algorithms, namely, JIO-CCM and JIO-CCM-GS, for 
implementation. The transformation matrix and reduced-rank weight 
vector are jointly estimated to get the filter output. By using the GS 
technique to reformulate the transformation matrix, the JIO-CCM- 
GS algorithm achieves faster convergence and better performance 
than the JIO-CCM. The devised algorithms, compared with the ex- 
isting methods, show preferable performance in the studied scenar- 
ios. 
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